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Quasiparticle interference (QPI) in spectroscopic imaging scanning tunneling microscopy provides 
a powerful method to detect orbital band structures and orbital ordering patterns in transition metal 
oxides. We use the T-matrix formalism to calculate the QPI spectra for the unconventional meta- 
magnetic system of Sr3Ru2C>7 with a £2 S -orbital band structure. A detailed tight-binding model 
is constructed accounting for features such as spin-orbit coupling, bilayer splitting, and the stag- 
gered rotation of the RuO octahedra. The band parameters are chosen by fitting the calculated 
Fermi surfaces with those measured in the angular-resolved photo-emission spectroscopy experi- 
ment. The calculated quasiparticle interference at zero magnetic field exhibits a hollow square-like 
feature arising from the nesting of the quasi-ld d xz and d yz orbital bands, in agreement with recent 
measurements by J. Lee et al. (Nature Physics 5, 800 (2009)). Rotational symmetry breaking in 
the nematic metamagnetic state also manifests in the quasi-particle interference spectra. 
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I. INTRODUCTION 

The physics of transition metal oxides is character- 
ized by a rich interplay among the lattice, charge, spin 
and orbital degrees of freedom^—. Various exotic phe- 
nomena, such as metal-insulator transitions and colossal 
magnetoresistance occur in orbitally active compounds 
with partially filled d or /-shells. In the literature many 
Mott-insulating orbital systems (e.g., Lai-^Sr^MnOa, 
La 4 Ru 2 Oio, LaTiOa, YTi0 3 , KCuF 3 ^ have been ex- 
tensively studied, and both orbital ordering and or- 
bital excitations have been observed. Significant de- 
velopments in orbital physics have also been made re- 
cently in cold atom optical lattice systems. In particu- 
lar, strongly correlated p-orbital bands filled with both 
bosons and fermions provides a new perspective on or- 
bital physics which has not yet been explored in the solid 
state context 9 ."— . In contrast, most p-orbital solid state 
systems exhibit only relatively weak correlations. 

Metallic orbital systems, such as strontium ruthen- 
ates and iron-pnictide superconductors, have received a 
great deal of attention of late. Their Fermi surfaces are 
characterized by hybridized ^-orbital bands, i.e., the 
eigen-orbital admixture of the Bloch state varies around 
a connected region of the Fermi surface. Orbital order- 
ing in such systems corresponds to a preferred occupa- 
tion along particular directions on the Fermi surface, and 
thus breaks the lattice point group symmetrj*i£~— . As a 
result, orbital ordering is equivalent to the anisotropic 
Pomeranchuk instability of Fermi liquids. 

Pomeranchuk instabilities are a large class of Fermi 
surface instabilities in the particle-hole channel with non- 
s-wave symmetry, which can be decomposed into both 
density and spin-channel instabilities. The density chan- 
nel instabilities often result in uniform but anisotropic 
(nematic) electron liquid states^—. These instabilities 
have been studied in the context of doped Mott insu- 
lators^, high T c material o 30 ' 36 , and quantum Hall sys- 
tems with nearly half-filled Landau level o 37 ' 38 . The spin 



channel Pomeranchuk instabilities are a form of "tm- 
conventional magnetism!^ analogous to unconventional 
superconductivit y 21 ' 31 : 32 ' 39 " — . The instabilities result 
in new phases of matter, dubbed /3 and a, which re- 
spectively are counterparts to the B (isotropic) and A 
(anisotropic) phases of 3 H o 41 ' 42 . Systematic studies of 
the ground state properties and collective excitations in 
both the a and /3-phases have been performed in Refs. 



41| and [42 



The t2g-orbital system of the bilayer ruthenate 
Si'3Ru207 exhibits an unconventional anisotropic (ne- 
matic) metamagnetic stated— , which has aroused much 
attentio n 29 ' 32 ' 48 " — . Sr3Ru207 is a metallic itinerant sys- 
tem with RuC>2 (ab) planes. It is paramagnetic at zero 
magnetic field, and below IK develops two consecutive 
metamagnetic transitions in an external magnetic field B 
perpendicular to the a6-plane at 7.8 and 8.1 Tesla. Be- 
tween two metamagnetic transitions, the resistivity mea- 
surements show a strong spontaneous in-plane anisotropy 
along the a and &-axis, with no noticeable lattice distor- 
tions. This feature, which is presumed to be of electronic 
order, may be interpreted as due to nematicity result- 
ing from an anisotropic distortion of the Fermi surface 
of the majority spin polarized by the external magnetic 
field 4 ^. Essentially this reflects a mixture of the rf-wave 
Pomeranchuk instabilities in both density and spin chan- 
nels. Recently, different microscopic theories have been 
constructed based on the quasi-ld bands of d xz and d yz 
by two of usi 9 - and also by Raghu et al^, and based 
on the 2d-band of d xy by Puetter et al£^. In our the- 
ory, the unconventional (nematic) magnetic ordering was 
interpreted as orbital ordering among the d xz and d yz - 
orbitals. 

Unlike charge and spin, orbital ordering is often dif- 
ficult to measure particularly in metallic systems. Re- 
cently, the technique of spectroscopic imaging scan- 
ning tunneling microscopy (SI-STM) has been applied 
to the active d-orbital systems of Sr3Ru2 0?££ and 
Ca(Fei_ 2; Co a; )2As2^ 7 -. The SI-STM quasi-particle inter- 



2 



ference (QPI) analysis is an important tool to study com- 
peting orders in strongly correlated systems^— , and 
has recently been applied to analyze the orbital band 
structure and orbital ordering in such systems. The QPI 
pattern in Sr3Ru207 exhibits characteristic square box- 
like features^, and that of Ca(Fei_a;Coa;)2As2 exhibits 
strong two-fold anisotropy— . In both cases, the QPI 
spectra are associated with the quasi-one dimensional d xz 
and dy Z -bands. 

In a previous paper—, two of us performed a theoretical 
analysis showing that QPI provides a sensitive method to 
detect orbital degree of freedom and orbital ordering in 
the quasi-ld d xz and d yz bands. The T-matrix acquires 
momentum-dependent form factors which extinguish cer- 
tain QPI wavevectors and result in crossed stripe features 
in the Fourier-transformed STM images. The orbital or- 
dering is reflected in the nematic distortion of the stripe 
QPI patterns. These results are in qualitative agreement 
with recent experiment o 56 ' 57 . 

In this article, we perform a detailed theoretical study 
of the QPI spectra in Sr 3 Ru207 , based on its £2 S -band 
structure. Various realistic features are taken into ac- 
count to construct the tight-binding model, including the 
bilayer structure, the staggered rotation of the RuO octa- 
hedra, and the on-site spin-orbit coupling. In addition, in 
order to account for the fact that STM is a surface sensi- 
tive probe, a potential bias is added between the top and 
bottom layers. Our calculation clearly shows the square 
box-like feature arising from the QPI in the d xz and d yz - 
bands, which agrees well with the experimental data in 
Ref. [561 ] . Furthermore, we predict a reduction of the 
four-fold rotational (64) symmetry to two- fold (C2) in 
the unconventional (nematic) metamagnetic states. 

This article is organized as follows. In section UIl we 
construct a detailed tight-binding model to describe the 
bilayer t 2 g-band structures. We choose the model param- 
eters so as to fit the experimentally measured Fermi sur- 
face from angular resolved photon emission spectroscopy 
(ARPES). In section Um we present the T-matrix method 
for the QPI spectra for the multi-orbital band systems. 
The fact that the experimentally measured QPI is pre- 
dominantly due to the top layer is carefully taken into 
account. In section ITVl we show the calculated QPI pat- 
terns and a comparison with experiments. Predictions 
are then made for the QPI pattern in the presence of 
the nematic orbital ordering. Conclusions are given in 
section [VlJ 

II. TIGHT-BINDING MODEL FOR THE 
BILAYER t 29 -ORBITAL BAND 



pattern of the RuO octahedra. In this section, we derive 




FIG. 1: (Color online) The lattice structure in a single layer of 
Sr3Ru207. The small yellow circle represents the octahedra 
oxygens which rotate about 6.8° (the angle in the plot is a 
little exaggerated) with respect to the z axis on the Ru sites. 
The red curves show the orientations of the Ru d xy orbitals. 
Because the direction of the rotation is opposite for nearest 
neighbor Ru sites, two types of the sublattice are identified as 
A (blue dot) and B (white dot). The direction of rotation is 
also opposite from bottom to top layers, leading to the switch 
of the sublattices A and B in different layers. 



the form of the tight-binding model based on symmetry 
considerations. 

The lattice structure of one layer of Sr3Ru207 is plot- 
ted in Fig. [TJ showing the rotation of the octahedra oxy- 
gens with opposite directions between neighboring Ru 
sites. Neutron diffraction measurement^ indicated that 
the rotation directions are reversed on the top and bot- 
tom layers. This staggered rotation pattern leads to not 
only a unit cell doubling but also additional hoppings 
which are absent in a perfect square lattice, and it is cru- 
cial to take this detail into account in constructing a real- 
istic tight-binding model. To make the discussion simple, 
we divide the hopping terms into four parts: the in-plane 
hoppings existing without rotations H ™ TRA ; the in-plane 
hoppings induced by the rotations _ff™ TRA , the inter-layer 
hoppings existing without the rotations i/™ TER 7 and fi- 
nally the inter-layer hoppings induced by the rotations 

j^INTER 



The bilayer ruthenate compound Sr 3 Ru 2 07 has a 
quasi-two dimensional layered structure. Its band struc- 
ture in the vicinity of the Fermi level is dominated by 
the t2g-orbitals on the Ru sites, and is complicated by 
the on-site spin-orbit coupling and the staggered rotation 



Uniform hopping terms without RuO 
octehedron rotation 



The Hamiltonian for ff™ TRA has been presented in 



Refs. ;20] and [55j. Following Ref. |55j, H{ NTRA reads 
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^TNTRA 



"*3 
-*6 



-<4 



t(F + 24) d*« (f) + <^(r + 20) (f) 
<f a t(f + x y) < z a (f) - <^(f + x + y) 



CaV + x + y) dZ(r) + dZHr + x - y) d% a <f) 



H.c. 



(1) 



which includes longitudinal fa) and transverse fa) hop- 
ping for the the d xz and d yz orbitals, respectively, as 
well as are nearest neighbor fa), next-nearest neighbor 
fa), and next-next-nearest neighbor (is) hopping for the 
d xy orbital. The summation indices r, s, and a refer 
to the position of Ru sites, the spin, and the layer in- 
dices. While symmetry forbids nearest- neighbor hopping 
between different t2 g orbitals in a perfect square lattice, 
due to the rotation of the oxygen octahedra, we include 
a term describing hopping between d xz and d yz orbitals 
on next-nearest neighbor sites fa). In each layer, the Ru 
sites r lie on a square lattice; we set the lattice constant 
to unity throughout. 

We assume \t§\ « |ii| ^> fa\, in accordance with the 2d 
nature of d xy and quasi-ld nature of d yz and d xz orbitals. 
While the hopping integral t 2 arises from the direct over- 
lap of the Wannier wavefunctions for the t2 g bands, the 
major contributions to t\ and £3 are from the hopping 
through the oxygen 2p-orbitals. The corresponding hop- 
ping processes are sletched in Fig. [2j The signs of nearest 
neighbor hopping integrals t\ and t% can be obtained from 
the second order perturbation theory: 



tpd{ tpd) 

Ed — E„ 



< 0. 



(2) 



where t p d is defined as the hopping integral between the 
ruthenium d xz orbital at position r and the oxygen p z or- 
bital at position r+^x, which is identical to that between 
the Ru d yz orbital at r and the O p z orbital at f + ^x. To 
get f3, replace the d xz or d yz orbital with the d xy orbital. 
The sign follows from the fact that — E p > 0. As for 
t2, since is results from a direct overlap, as shown in Fig. 
[UJb), we have t 2 > 0. Their magnitudes are estimated as 
ti w t 3 « 300 meV and t 2 /h « 0.1 from a fitting of LDA 
calculations on Sr2Ru0 4 63 i 64 . For the long distance hop- 
pings *4,5 whose magnitudes are smaller, their values are 
put by hand for later convenience. The on-site potential 
for the d xy orbital V xy is introduced to take into account 
the splitting of the d yz and d xz states relative to the d xy 
states which was found in LDA calculations 65 . We take 
V xy /h = 0.3. 



The last term in H™ TRA describes the on-site spin- 
orbit coupling, the energy scale of which is estimated in 
Ref. [6(| to be A = 90 meV, based on a first principles 
study of Si'2Ru04. This term couples the d xy and d XZjVZ 
orbitals. Truncated in the three-dimensional subspace of 
t 

of the L operators reads 



2 g orbitals spanned by (d yz , d xz , d xy ), the matrix form 
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L z = 




(3) 



It is important to notte that, unlike the usual angular 
momentum operators, the truncated matrices satisfy a 
different commutation relation, i.e. 

[Li,Lj] = -ie ijk L k . (4) 

The Hamiltonian Eq. [T] is expressed in momentum 
space as 

J^INTI 



E[^ a (fc)is(fc)^, a (£)+H.c. 



(5) 



k . a 



where ip s ,a(k) is defined as a 3-component spinor as 

m = [< Q (fc), d™(k),<f_l a (k)] T and dfjk) anni- 
hilates an electron with orbital a and spin polarization 
s at momentum k in the top (a — t) or bottom (a = b) 
layer. The matrix kernel A s (k) in Eq. [5] is 



A s (k) 



e off 
k 



yz 

i 



isX 



£ off 



isX 



k 



- sX 
iX 



(6) 



xy 



sX —iX 

where the dispersions for the d yz , d xz , and d xy bands are 



LIZ 



-2t? cos fc T 



e~ z = -2ticosfc. 



e x J = -2t 

k 



2t\ cos k y , 
2t 2 cos k y , 
3 1 cos k x + cos k y ) - 4< 4 cos k x cos ky 
2t$ ( cos 2k x 4- cos 2ky) — V xy , (7) 



4 



(a) 
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FIG. 2: (Color online) Hopping processes for (a) ti and tz (b) 
i2. For each i,j,k, it can be x,y,z, but i ^ j ^ k. (a) The 
hopping processes described by fi and tz are assisted by the 
p orbital of oxygens, (b) The hopping process described by 
ti is through the direct overlap between two identical orbitals 
on the nearest-neighbor Ru sites without going through the 
oxygen, thus it is much weaker than t\ and tz- 



and 



-Ate, sin k x sin k„ 



(8) 

As for H™ TETl , since the wavefunction of the d xy orbital 
lies largely within the a5-plane, its inter-layer hopping is 
assumed negligible in comparison to that for the d xz and 
This leads to 



dyz-orbitals 



B. 



-t 



E E{<t(fc)<b(fc)+H.c.} (9) 



a=xz,yz k 



Staggered intra-plane hopping induced by 
staggered rotation of RuO octehedron 



In this subsection, we study the additional intra-plane 
hoppings induced by the staggered rotation of the oc- 
tahedron oxygens. The leading effect of this rotation is 
to enable hopping between different orbitals on nearest 
neighbor sites. A spin-dependent hopping between d xy 
band due to the spin-orbit coupling has been discussed 
in Ref. [13] ■ In the following, we neglect the weak break- 
ing of reflection symmetry of each ab plane due to the 
bilayer structure. Since d yz and d xz are odd and d xy is 
even under this reflection z — > — z, the inter-orbital hop- 
pings between d yz (or d xz ) and d xy are still zero under 
this assumption. Therefore we only need to consider the 
hopping between d yz and d xz orbitals. In the following, 
we will show that this inter-orbital hopping has staggered 
signs in the real space, which causes a unit cell doubling 
as seen in LDA calculations^ and ARPES experiment^. 

We start with the hopping along the x-direction with 
spin s and in the layer a, and consider the hopping be- 
tween d yz and d xz orbitals illustrated in Fig. [3ja) as 



FIG. 3: (Color online) The Wannier wavefunctions of the d yz 
and d xz with the lattice distortion. The blue and white dots 
denote sublattices A (with x + y odd) and B (with x + y even), 
and the gray dots denote the oxygens. The sign indicates the 
sign of the wave function in the positive z plane, and the wave 
functions in the negative z plane have opposite signs. 



This lattice structure has an inversion symmetry I with 
respect to site r, and under such an inversion the orbitals 
transform as: 



ldZ(r±x)l = dZ(rTx) 



(11) 



with corresponding relations holding for the d v s z a orbital. 
Therefore we have 

Z^J (*0 = dZ(r + i) ■ (12) 

The crystal also exhibits a reflection symmetry with re- 
spect to the yz planes containing the oxygen sites. Let 
us define J as the reflection operation with respect to 
the yz plane containing the oxygen site between r and 
r + x. Under the operation of J , 



JdZ(r)J = -d x s z a(r + x) 
Jdi: a (f)J = +di z a (r + x) 



(13) 



Thus, 



JdZHr) dZ(r + x) J = -d$(?+ x) d£(f) , (14) 
Combining Eg . s [1^1 and [T4l leads to: 

JldyZH^dZ(r-x)IJ = -d^(r + £)dT a (r) , (15) 

which means that this hopping is staggered. 

Note that the above discussion is generally valid re- 
gardless of the intermediate state of the hopping process. 
The intermediate state, however, is important to give the 
second order perturbation expression for i INT as 

.a/9 (r,a\H Ru0 \m)(m\H Ru0 \r',j3) 
t~> =~2^ eT B . (l g ) 



Ed — E n 



(10) 



where a,/3 = xz,yz. Hr u o describes the hopping be- 
tween the tig orbital on Ru sites and the 2p orbitals on 
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neighboring O sites. \m) denotes an oxygen 2p orbital, 
which is an intermediate state for the Ru-Ru hopping 
processes. Because of the reflection symmetry with re- 
spect to the xy plane and the fact that d yz and d xz are 
odd under this reflection, {r,a\H Ra o\m) is non-zero only 
if the intermediate state is also odd under this reflection. 
As a result, \m) can be only \p z ). However, in order to 
determine the sign and the magnitude of ti NT , a detailed 
knowledge of the pseudopotentials for the Hamiltonian 
-HruO is required, which is beyond the scope of this pa- 
per. Nevertheless, since this term is expected to be small 



and its main consequence is to provide the necessary cou- 
pling between k and k+Q, where Q = (tt, 7t), we can treat 
it as a fitting parameter. 



Similar reasoning can be applied for the hybridized 
hopping between d xz and c?j, 2 -orbitals along the in- 
direction, which is also staggered. Furthermore, the C4 
symmetry around each Ru site relates the staggered hop- 
pings along the x and y-directions. Putting all the above 
together, we arrive at the staggered in-plane hopping con- 
tribution to the Hamiltonian 



J 



rrlNTRA 
H 2 



= -t 



1- V T ( ) 6 



dZ(r + S) d£t(f) (r + 5) 



H.c. 



(17) 



where 8 ranges over x and y, (—1)° = Tl for top and 
bottom layers, respectively, and where in our convention 
e iQ-r _ -pj £ or ^ j n A (B) sublattice. Note that there 
is only a single independent parameter i INT to character- 



ize this in-plane staggered hopping. 

It is straightforward to transform Eq. [T7] into momen- 
tum space as 



J 



ff™ = -2t INT ]T '(-) a (cos k x + cos k y ) fet(fc + Q) dZ(k) ~ dZHk + Q) 



H.c. , 



(18) 



r 



where the prime on the sum indicates that k is restricted 
to only half of the Brillouin zone. 



C. Inter-layer staggered hopping 

In this subsection, we study the additional hybridized 
inter-layer hopping between different orbitals, i.e., the 
winter term. This contribution arises because the ro- 
tation patterns of the RuO octahedra in the two layers 
are opposite to each other. Because the d xy and d xz / yz 
orbitals have different azimuthal quantum number of or- 
bital angular momentum, they do not mix, even in the 
presence of the RuO octahedra rotation. The leading 
order inter-layer hybridization therefore occurs between 
d xz and d yz orbitals, and the hybridization Hamiltonian 
is 



77INTER 

H 2 



<tV)Cb(r) 



(19) 



H.c. 



Next we use the second order perturbation theory to 
derive the staggered inter-layer hopping intergrals. We 



consider two hopping processess: (1) hopping from d xz 
orbital at sublattice A on the bottom layer to d yz orbital 
at sublattice B on the top layer, and (2) hopping from 
dy Z orbital at sublattice A on the bottom layer to d xz 
orbital at sublattice B on the top layer. The hopping 
intgrals for these two processes can be written as: 



7) I 

*(2) . 



(r, yz, b|g Ru0 |m) (m\H Ru0 \f,xz, t) 
Ed — E m 



1 bt 



(fj xz i b|g R ,uO \m) {m\H Ru0 |r, yz, t) ^ 



Ed — E„ 



where i belongs to sublattice A in the bottom layer and 
sublattice B in the top layer by our convention. Because 
the d xz and d yz are odd under the rotation of 90° with 
respect to the z axis despite of the O-octahedral rotation, 
their overlaps with p z are zero. Therefore the these two 
processes can only go through p x and p y orbitals of the 
oxygen between the layers. Fig. U presents the views of 
wavefunctions from the topview. It should be noted that 
for the top layer, the components of the wave functions 
having largest overlap with the oxyegn p orbitals are the 
one in the negative z so that there is an additional minus 
sign in addition to those plotted in the Fig. [3J Unlike 
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the case of f INT , because the Ru atoms on the top and 
bottom layers and the oxygen between them are colinear, 
the signs of t^f can be determined from the geometry 
shown in Fig. 3) We can then obtain: 

(r,xz,b\H RuO \p x ,0) ■ (p x ,0\H RuO \r,yz,t) > 
(f,xz,b\H RuO \p y ,0) ■ (p y ,0\H RuO \r,yz,t) > 
(r,yz,b\H RuO \Px,0) • (px,0\H RuO \f,xz,t) < 
(r,yz,b\H RuO \p y ,0) ■ (p y ,0\H RuO \r,xz,t) < , 



where \p x , 0} is the oxygen 2p x orbital with planar posi- 
tion r situated midway between the top (t) and bottom 
(b) ruthenium sites. Together with Ed — E p > 0, we con- 



clude that t 



(i) 
lit 



-t 



(2) 
lit 



t 



> 0. It can also be easily 



generalized that if r belongs sublattice B (A) in the bot- 
tom (top) layer, we have obtain the same result except 
an opposite sign. 

Now we transform into momentum space, after which 
the H 2 NTER term reads 



ttINTER 

H 2 



= -t 



k 



'[e^(fc + 3Kl(fc)-<^^ (21) 



(a) 






FIG. 4: (Color online) The wave functions viewed from the 
top of the material. The dashed line represents the wave 
function of the d orbitals on the top layer, and the solid line 
for those on the bottom layer. The smaller figures represent 
the p orbital of the oxygen between layers with the red lobe 
having positive sign and the white lobe having negative sign. 
Note that the signs of the d orbitals indicates those of the 
wave functions closest to the the oxygen, (a) d xz at bottom 
layer and d yz at top layer, and (b) d yz at bottom layer and 
d xz at top layer. 



D. Fermi surfaces 



Adding up the contributions from Eqs. [5J [51 HB and 
1] leads to the tight-binding model 



H Q = 



^JINTRA _|_ y^TNTER _|_ J^TNTRA _|_ 



INTER 

2 



(22) 



^k,s k ^k,s 



where 



and 



/ L+(k) -Gt(fc) B\ 
-G{k) L+(k + Q) B\ 



m 



B 1 B 2 L-(k) Gt(fc) 

V B 2 B x G(k) L~(k + Q)J 



(23) 



4 . = «t® > <t(£ + Q) > b W , i>l b (fc + Q)) , 

(24) 

with = fet(fc),^(fc),^(fc))^ as before 

(see Eq. O. The matrix kernels L^(k), G(k), Bi, and B 2 
in Eq. [231 are defined as 

L a s (k) = A s (k) -(fx- i(-l) a V hias ) I , (25) 



G(k) 





2t mT j(k) 









(26) 



and 




Bo 



^INT 

-4 T o o 





(27) 

where j(k) = cos k x + cos k y , /i is the chemical potential, 
and Vbias is the difference of on-site potential in the top 
and bottom RuO layers. The Vbi as term induces more 
splitting of bonding and anti-bonding solutions between 
layers, as will be discussed in the following sections. 

For Vbias = 0, H can be reduced to two independent 
parts classified by the bonding and anti-bonding solu- 
tions with respect to the layers. To see this, first we per- 
form a gauge transformation in Hq, sending d v s z ^ xz (k + 

Q) — > — dfj IZ (fc + Q). Then we introduce k z = 0,7r to 
perform a Fourier transform on the layer index. We have: 



H (V hias = 0) = h (k z = 0) + h Q (k z = tt), (28) 
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1.0 -0.5 0.0 0.5 1.0 



FIG. 5: (Color online) The Fermi surfaces using the bilayer tight-binding model with the parameters: t\ — 0.5, t-z = 0.05, t$ = 
0.5, U = 0.1, t s = -0.03, te = 0.05, t± = 0.3, W = t£, T = 0.05, A = 0.1, V xy = 0.15, and /i = 0.47 for (a) V bias = 0, (b) 
Vbias = 0.1, (c) Vbias = 0.2, and (d) Vbias = 0.3. The thick dashed lines mark the boundary of half Brillouin zone due to the 
unit cell doupling induced by the rotation of octahedra oxygens, (a) For Vbias = 0, the Fermi surfaces of the bonding (k z — 0, 
black solid lines) and the anti-bonding bands (k z — n, red dashed lines) could cross since k z is a good quantum number, (b) 
As Vbias is turned on, the crossings of the Fermi surfaces with different k z are avoided, (c) The optimized The Fermi surfaces 
are obtained with Vbias = 0.2. Fermi surface shhets of aci, Qz, 7i, 72, 73, and /3 are marked. The 71,2 sheets have dominant 
2-D d xy orbital character while the 011,2 sheets are mostly formed by quasi-ld d yZtXZ orbitals. The 73 sheets are not seen in the 
ARPES measurements, (d) For Vbi as = 0.3, the Fermi sheets of 72 disappear. 



with ho(k z ) defined as 



and 



h 0s (k,k z ) g^{k,k z ) \ $ 
g(k,k z ) h 0s (k + Q,k z )J k ^ 

(29) 



In Eq. [2£l ho s , g(k, k z ) and $t fc are defined as 



h 0s {k,k z ) = A s (k) + B 1 cos k z (30) 
g(k,k z ) = G(k) - 2B 2 cosk z 



k,s,k z 



(d y - z 1 dt 

^ k,s,k z ' k,s,k z 



k+Q,s,k z 



k, 

' k+Q,s.k z 



(31) 



k+Q, 



■ kj 



The Fermi surface for Vbias = is plotted in Fig. EJa). 
It consists of many disconnected sheets. Since k z is a 
good quantum number, the individual Fermi surfaces of 
the bonding and anti-bonding bands could cross; this in 
fact makes it easier to analyze how the Fermi surfaces 
are formed due to hybridization among the ti g bands. It 
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-1.0 -0.5 0.0 0.5 1.0 

FIG. 6: (Color online) The analysis of the Fermi surface for- 
mation for Vbias = 0. Two copies of the Fermi surfaces of 
Sr2Ru04 are labeled as a e , /3 e , ~/ e for bonding and a", f3°, 
7° for anti-bonding bands. The back-folding of the Brillouin 
zone from the corners produces identical partners for each 
band appearing at positions connected by the wave vector 
Q — (it, 7r) (the dotted arrow), leading to the Fermi surfaces 
plotted in Fig. Eta). 



has been illustrated in Ref. [(38| that the Fermi surface 
of S^R^Oy can be schematically understood from that 
of Sr2Ru04. In S^RuC^, the hybridizations of the tig 
bands result in three eigenbands: a and j3 bands with 
mostly quasi-ld d yz and d xz characters, and 7 band with 
dominant d xy character. For Vbias = 0, we can begin 
from two copies of the Fermi surfaces of Sr2Ru04 since 
the bilayer splitting doubles for each band. From our cal- 
culations, three bonding bands (a e , /3 e , and 7 e ) and three 
antibonding bands (a°, f3°, and 7 ) are clearly identified, 
as shown in Fig. [6l Finally, due to the unit cell doubling 
induced by the rotated oxygen octahedra, the Brillouin 
zone is back-folded from the corners with respect to the 
dashed lines. As a result, each of the six bands will have 
an identical partner appearing at positions connected by 
the wave vector Q — (n, 7r), producing the Fermi surfaces 
plotted in Fig. EJa). 

When Vbias 7^ 0, the crossings of the Fermi surfaces 
between bond and anti-bonding bands can be avoided 
because the Vbias term breaks the bilayer symmetry. To 
match the observed ARPES results 5 -^, it is crucial to 
avoid these crossings in order to obtain the correct shapes 
of the Fermi surface sheets. This suggests that a finite 
Vbias is a necessary aspect of any realistic model. Figs. 
02b)- (d) show the Fermi surfaces with several different 
value of Vbias, and it can be seen that the crossings of 
the Fermi surfaces are all avoided when Vbi as 7^ 0. Fig. 
02c) shows the Fermi surface with optimized parameters 



fit to the ARPES experiment 5 ?. The agreement with ex- 
periment appears satisfactory. The Fermi surfaces of a±, 
a 2, 71, 72, and f3 identified from the ARPES are clearly 
reproduced with the correct shapes. Moreover, the aver- 
age filling per Ru atom with these optimized parameters 
is 4.05, which is also consistent with the valence charge 
of Ru atoms in Sr3Rri2 07. 

One major discrepancy is the appearance of additional 
electron Fermi pockets, 73, enclosed by the j3 bands as 
shown in Fig. 03c). While the LDA calculation also 
showed the existence of 73 pockets, ARPES did not ob- 
serve them. We suspect that this band might be too 
small to be resolved in the spectral weight measured by 
ARPES, and other measurements like quantum oscilla- 
tions might be more sensitive to this band. 



III. T-MATRIX FORMALISM FOR THE 
MULTIBAND SYSTEMS 

QPI imaging has been studied using a T-matrix 
formalism for various systems including the high- 
T c cuprate o 58 ! 60 , multiband systems with quasi-ld ri- 
bands 6 -, iron-pnictide superconductors^, and topolog- 
ical insulators P^Te ^ 70 ' 71 , etc.. The scattering mecha- 
nism for the quasiparticles is usually taken to be elastic 
impurities, and is modeled by a local variation of the 
orbital energies. Because the impurites are introduced 
mainly on the surface of the material 56 , we consider a 
single impurity at r = on the top layer only. Assuming 
that the impurity has the same effect for all orbitals, the 
impurity potential is modeled by 

ff MP = V £ dlt {? = 0) d?, t (r = 0) , (32) 

a 

where the orbital label a runs over all three possibilities 
xy, yz, and xz. In Fourier space, then, 

H1MP = § E <t f 

k,k f ,s 

where 

■ «=(/;)■ w 

with / the 3x3 identity matrix, O is a 6 x 6 matrix of 
zeroes, and where cpl is defined in Eq. |2"41 

Extending the standard T-matrix formalism to multi- 
band systems^, we have that the Green's function satis- 
fies the following matrix equation with dimension 12 x 12: 

G(fc,p» = G°(k)S %f +G°(k)f(k,p,u;)G (f) , (35) 
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where G°(k) is the unperturbed Green's function defined 
as: 

G°(k) = u) + ir]-H (k) 1 (36) 
and T{k,p, ui) is the T-matrix, which satisfies 
T(k, p, io) = V(k,p) + jjYlvik, k 1 ) G° (k') f(k',p, u) 

(37) 

Note that the momenta k and p are both restricted the 
half Brillouin zone. Since V is momentum- independent, 
the T-matrix is also momentum-independent which can 
be easily evaluated as: 

-l 



1.0 



T( W ) 



V 



(38) 



The local density of states (LDOS) on the layer a for 
orbital a, spin s at position r and sample bias voltage V, 
p" a (f,E = eV) can be evaluated by: 



1 E' 



,i(f-k)-f 



GfJk,p,E) 



k.p 



+G:jk + Q,p + Q,E) 



J(p-k-Q)-f 



GfJk + Q,p,E) 



+g« a (k,p + Q,E) 



(39) 



where Q° a (k, k', u) = Jdt e^(T t d% s Jt)d^ s JO)) can 

be read off from Eq. [35] Generally speaking, the dif- 
ferential conductance dl/dV measured by the STM is 
proportional to the LDOS. However, special care must 
be taken in order to account for certain experimental de- 
tails, as we will discuss in the following section. 



IV. RESULTS 

A. General discussions 

First, it is important to mention that because exper- 
imentally the tip of the STM is much closer to the top 
layer, it predominantly measures the LDOS on the top 
layer. Second, because the wave functions for different 
orbitals could have different overlaps with the STM tip, 
the tunneling matrix elements may be orbital-dependent. 
Therefore, the simplest model to relate the conductance 
dl/dV and the corresponding LDOS can be written as: 



$(r,E)<xp(r,E) 



C a pl t (P,E). (40) 



Finally, the QPI imaging can be obtained by performing 
the Fourier transformation of p(r, E), viz. 



iy, 

N ^ 



r p(r,E) 



(41) 



-0.5 
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FIG. 7: (Color online) QPI imaging at zero sample bias volt- 
age (E = 0) contributed from scatterings (a) within all ti g 
bands, (b) within 2-D band d xy , and (c) within two quasi-ld 
bands d yz and d xz . The scattering potential is introduced 
only for top and bottom layers with Vb = 1.0, reflecting the 
fact that the impurities are usually in the top layer. Only the 
LDOS on the top layer are calculated, (b) The strong features 
are due to the scatterings between the small hole pockets 72 
and the parts of 71 marked by the solid lines in Fig. [8] A rep- 
resentative strongest wavevector qi is also indicated, (c) The 
strongest wavevectors g*2-4 can be understood by scatterings 
indicated in Fig. [8] The stripe-like features enclosed by the 
ovals (both black and yellow) result from the flat parts of the 
01,2 bands, which are the signatures of the quasi-ld bands. 



In this paper, we plot \p(q, E)\ only for q^O since we 
are interested only in the change of the local density of 
states due to the impurity. A 101 x 101 square lattice 
is used in the wavevector summations, and a broadening 
factor 77 = 0.02 (i.e. an imaginary part to the energy) is 
introduced by hand. 

We first compute the QPI imaging at zero sample bias 
voltage (E = 0). Fig. [Tfa) shows the QPI imaging due 
to impurity scattering from all three ti g bands. The plot 
exhibits several features which can be understood as fol- 
lows. Since the contributions to the LDOS from different 
t2 g bands can be computed independently as seen in Eq. 
[39l we also compute separately the QPI imaging for the 
2-D d xy band (Fig. [7^b)) and for the quasi-ld d yz and 
d xz bands (Fig. [TJc)) for comparison. The strong fea- 
tures seen in Fig. [TJb) come from the scatterings within 
and between 7^2 pockets (the red solid lines in Fig. [8]). 
This is to be expected, since both pockets have dominant 
d xy orbital character. As for Fig. [Tfc), the signature 
stripe-like patterns of the quasi-ld bands^ can clearly 
be seen, and we find that the dominant features largely 
come from the a-i band scatterings, as indicated in Fig. 
[5] The reason why the «2 band scatterings are much 
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FIG. 8: (Color online) The scattering processes related to 
strongest features in Fig. [7] The scatterings within and be- 
tween the parts of Fermi surfaces marked by the red solid 
lines, which are mostly from 71 and 72 pcoktes, contribute the 
dorminant features in the QPI image of 2d band d xy shown in 
Fig. [7Jb). A representative strongest wavevector <fi shown in 
Fig. [TJb) is plotted. As for the QPI image of quasi- Id bands 
dyz tXZ shown in Fig. [3c) > the dorminant scatterings related 
to strongest wavevectors 0*2-4 occur mostly within ai band, 
as indicated by the arrows. 



more prominent than the a\ band scatterings is that the 
«2 (c*i) band is mostly composed of the anti-bonding 
(bonding) solution with respect to the layers, with more 
(less) weights on the top layer. Since we only compute 
the LDOS on the top layer, the band scatterings are 
much more important than the a± band scatterings. 

Another general feature present in Figs. [3 also [TOl and 
1111 is that while the Fermi surfaces without a nematic 
order have not only the C4 symmetry but also inversion 
symmetries with respect to k x and k y axes, the QPI pat- 
terns do not have the inversion symmetries with respect 
to q x and q y axes. The reason for this discrepancy is 
delicate, and we will explain in the following. As can be 
seen in Fig. [1] the inversion symmetry is defined only 
as the inversion axis chosen to pass through the oxygen 
sites. Since we have the degree of freedom to choose the 
inversion axis as computing the Fermi surfaces, Bloch 
theorem ensures that the system has the inversion sym- 
metry. However, when computing QPI patterns, we have 
to put an impurity on one Ru site. As a result, we can 
only choose the inversion axis passing through this im- 
purity at Ru site, which explicitly breaks the inversion 
symmetries. This explains why the QPI patterns do not 
have the inversion symmetries as the Fermi surfaces do. 

It can be seen that Fig. [7£c) alone captures the main 
features of the experimental results of Rcf. [56], sug- 
gesting that the contribution from the 2d d xy band is 
essentially invisible in SI-STM experiment. The miss- 
ing of d xy band scatterings in the experiment can be 




FIG. 9: (Color online) Schematic illustration of the wave func- 
tion overlap related to the tunneling matrix element for STM 
tip. The tunneling of electrons from the STM tip to the d- 
orbitals of the Ru atoms must go through the oxygen atoms 
(white dots), (a) For di Z orbitals (i — x,y), the tunneling 
matrix element is large with the help of the p; orbital of the 
oxygen atoms, (b) For d xy , all p-orbitals of the oxygen atoms 
have zero wave function overlaps with it, leading to much 
weaker tunneling matrix element compared to d yz>xz orbital. 

explained by appealing to the aforementioned orbital- 
dependence of the STM tunneling matrix elements. Be- 
cause the surface of the material is usually cleaved such 
that the outermost layer is the oxygen layer, there is an 
oxygen atom lying above each uppermost Ru atom. As 
a result, the tunneling matrix element will be mostly de- 
termined by the wavefunction overlaps between the p- 
orbitals of the oxygen atom and the d-orbitals of the Ru 
atom. As illustrated in Fig. [SJ the wavefunction over- 
laps of the d yz {d xz ) orbital with the p y (p x ) are large 
while none of the p-orbitals has finite overlaps with d xy 
orbital, leading to C xy < C yz = C xz . Moreover, the 
tunneling matrix elements also depend on the in-plane 
momentum k. It has been shown theoretically that the 
tunneling matrix elements have important effects in the 
tunneling spcctr a 57 i 72 ~ — . These matrix elements are sig- 
nificantly suppressed at large in-plane momentum^, and 
recent STM experiments on graphene^ and iron-pnictide 
superconductors 57 - have demonstrated this suppression. 
Since the 71.2 sheets are located around momenta much 
larger than those of 07,2, their contributions could be 
further suppressed by this effect. 

Based on the above discussion, we will henceforth set 

(jyz =( jxz = l and (jxy = Q 



B. QPI imaging at energy below the Fermi energy 

Since the experiments were done at negati ve sample 
bias voltage^, we compute the QPI imaging for several 
negative values of E. Fig. [10] present the QPI imaging 
for E = 0, —0.03, —0.06, —0.1, and the main features of 
the stripe-like patterns remain unchanged. This is also 
consistent with the experiments showing that the QPI 
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FIG. 10: (Color online) QPI imaging at (a) E = 0, (b) E = 
-0.03, (c) £ = -0.06, and (d) E = -0.1. The main features 
are similar because the Fermi surfaces of ai,2 are relatively 
insensitive to E throughout this energy range. 
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FIG. 11: (Color online) QPI imaging evaluated from Eq. [42] 
for (a) x = 0.25, (b) x = 0.5, (c) x = 0.75, and (d) x = 1. 
The QPI imaging in (a) fits the experimental result the best. 



imaging are similar for sample bias voltage down to E — 
— 12meV, and the reason is that the Fermi surfaces of 
a i.2 do not change very much throughout this range of 
energy. 

C. QPI imaging for impurities at different layers 

The above calculations were all performed assuming 
that the scattering impurity is located on the top layer 
only. However, QPI from impurity scattering in the sec- 
ond layer may also be detectable in experiments. Since 
the measurements of the conductance dl/dV are more 
likely an average of both cases, it is reasonable to expect 

J£(f, E) oc (1 - a;)p TOP (r, E) + xp BOTTOM (r, E) , (42) 

where p TOr (f, E) is the LDOS of quasi-ld bands with 
impurity on the top layer, and Pbottom(?, E) is that with 
impurity on the bottom layer. We can then obtain the 
QPI imaging by performing a Fourier transformation on 
Eq. 221 as a function of x. The results are presented in 
Fig. [IT] for x = 0.25,0.5,0.75,1. We find that x = 0.25 
best reproduces the experimental data of Ref. [56| . 

V. IMPLICATION OF ORBITAL ORDERING 
FROM QPI IMAGING 

Two of us^ 9 - have proposed that the nematic order ob- 
served in this material results from an orbital ordering 
in the quasi-ld bands enhanced by the orbital hybridiza- 
tions. The charge and spin nematic order parameters 
n c ,n sp can be expressed as: 

«c = l(M-W) , n c =((S* z )-(S* z }). (43) 



The mechanism of the nematic order under the magnetic 
field is that the majority spin band is pushed closer to the 
van Hove singularity, which triggers the nematic distor- 
tion in the majority spin Fermi surfaces. The mean field 
theory 19 with a microscopic model of quasi-ld bands also 
reproduced this feature, leading to n c = n sp . To calcu- 
late the QPI imaging with a nematic order, we introduce 
two new terms into the Hamiltonian: 

Hncnatic = N £ {dfj (r) d»* (f) - d^J (f) d?*(f)) 
f*,a 

Socman = £ (d^ (f) <£j? a (f) - <f& (f) (f)) , 

where N — n c + n sp measures the strengths of the ne- 
matic distortion in the majority spin Fermi surfaces. Fig. 
[T2l shows the QPI imaging at E = with N/ti — 0.1 and 
HsB/ti — 0.06. As expected, a stripe-like pattern break- 
ing the C4 symmetry down to C2 symmetry is observed. 

We propose that this result could be used to resolve the 
controversy on which band is responsible for the nematic 
order. If the nematic order occurs mostly in the d xy band 
and the quasi-ld bands do not exhibit orbital ordering, 
the QPI imaging from the experiments should have a C4 
symmetry even within the range of the nematic order 
because the SI-STM is not sensitive to the d xy band. 
Conversely, if the orbital ordering in the quasi-ld bands 
is responsible for the nematic phase, the SI-STM will see 
the imaging with only C2 symmetry, as shown in Fig. 1121 



VI. CONCLUSIONS 

In this paper, we have constructed a bilayer tight- 
binding model with three ti g orbitals for the Sr3Ru207, 
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FIG. 12: (Color online) QPI imaging with nematic order. 
N/ti — 0.1 and /xs-B/ti = 0.06 is chosen. The breaking of 
the d symmetry to C2 symmetry is clearly seen. 

with careful attention paid to details of the lattice struc- 
ture. We found that the rotations of the in-plane octahe- 
dra oxygens induce new hoppings between quasi-ld d yz 
and d xz bands with staggered signs in the hopping inte- 
grals, which in turn lead to a unit cell doubling consistent 
with what is observed in both ARPES experiment^ and 
LDA calculations 5 ^! 5 -. This mechanism for unit cell dou- 
bling is distinct from that in the model used by Puetter et 
al£^, in which a staggered on-site potential is introduced 
to distinguish the sublattices. Furthermore, we have also 
computed the quasi-particle interferences in the spectro- 
scopic imaging STM based on a multiband T-matrix ap- 
proach within this tight-binding model. Due to the ef- 
fects of tunneling matrix elements, we find that the the 
QPI imaging measured by Lee et. al£& are dominated by 
the scatterings in the quasi-ld d xz and d yz bands, and 
the contribution from the 2-D d xy band is largely sup- 
pressed. We have further considered the possibility of 
impurities residing on either top or bottom layers, and a 
linear combination of these two cases leads to the best fit 
with the experiments. 



We have also calculated the QPI imaging for the sys- 
tem with a orbital ordering in the quasi-ld bands in a 
magnetic field, and we propose that this could be a re- 
alistic way to distinguish which band is responsible for 
the nematic order. We predict that if the d xy band is the 
dominant band for the nematic phase and no orbital or- 
dering in quasi-ld bands is present, the QPI imaging will 
still preserve the C4 symmetry even within the nematic 
phase because the SI-STM could not detect the change 
in the d xy band. On the other hand, if the orbital or- 
dering in quasi-ld bands is responsible, a breaking of the 
C4 symmetry down to C2 should be observed in the QPI 
imaging as the system enters the nematic phase. 

One remarkable aspect in our tight-binding model is 
the introduction of Vbias, the difference in on-site poten- 
tial for the top and bottom layers. It has been shown here 
that the crossings of the Fermi surfaces with different 
'layer parities' can not be avoided without a Vbias term. 
In order to reproduce the Fermi surface sheets mapped 
out from the ARPES experiments, especially for 012, a 
non-zero Vbias is essential. Physically since the ARPES 
still measures mostly the electronic properties near the 
surface, it is reasonable to expect that the surface work 
function could produce a sizable Vbias to be seen in the 
ARPES. Furthermore, the fact that STM, another sur- 
face sensitive probe, detected only the «2 band scatter- 
ings also supports the existence of a non-zero Vbias- On 
the other hand, Vbi as vanishes inside the bulk, and thus 
the bulk Fermi surfaces would have different shapes and 
volumes from those obtained by ARPES 52 . This issue is 
important when comparing the Fermi surfaces measured 
in ARPES with those measured in quantum oscillations 
experiments, since the former is a surface measurement 
while the latter is a bulk one. 
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